Portable Measurement and Mapping of Continuous Piano Gesture
نویسنده
چکیده
This paper presents a portable optical measurement system for capturing continuous key motion on any piano. Very few concert venues have MIDI-enabled pianos, and many performers depend on the versatile but discontinued Moog PianoBar to provide MIDI from a conventional acoustic instrument. The scanner hardware presented in this paper addresses the growing need for alternative solutions while surpassing existing systems in the level of detail measured. Continuous key position on both black and white keys is gathered at 1kHz sample rate. Software extracts traditional and novel features of keyboard touch from each note, which can be flexibly mapped to sound using MIDI or Open Sound Control. RGB LEDs provide rich visual feedback to assist the performer in interacting with more complex sound mapping arrangements. An application is presented to the magnetic resonator piano, an electromagneticallyaugmented acoustic grand piano which is performed using continuous key position measurements.
منابع مشابه
Piano pedaller: a measurement system for classification and visualisation of piano pedalling techniques
This paper presents the results of a study of piano pedalling techniques on the sustain pedal using a newly designed measurement system named Piano Pedaller. The system is comprised of an optical sensor mounted in the piano pedal bearing block and an embedded platform for recording audio and sensor data. This enables recording the pedalling gesture of real players and the piano sound under norm...
متن کاملAugmented Piano Performance using a Depth Camera
We augment the piano keyboard with a 3D gesture space using Microsoft Kinect for sensing and top-down projection for visual feedback. This interface provides multi-axial gesture controls to enable continuous adjustments to multiple acoustic parameters such as those on the typical digital synthesizers. We believe that using gesture control is more visceral and aesthetically pleasing, especially ...
متن کاملBuilding a portable gesture-to-audio/visual speech system
We have constructed an easy-to-use portable, wearable gesture-to-speech system based on the Glove-TalkII and GRASSP gesture-controlled speech systems and a vizeme based face-synthesizer. Our new portable system is called a Digital Ventriloquized Actor (DIVA) and refines the use of the formant speech synthesizer. Using a DIVA, a user can speak using hand gestures mapped to both synthetic sound a...
متن کاملPiaF: A Tool for Augmented Piano Performance Using Gesture Variation Following
When performing a piece, a pianist’s interpretation is communicated both through the sound produced and through body gestures. We present PiaF (Piano Follower), a prototype for augmenting piano performance by measuring gesture variations. We survey other augmented piano projects, several of which focus on gestural recognition, and present our prototype which uses machine learning techniques for...
متن کاملNon-ionizing electromagnetic waves measurement and monitoring Systems
In this paper, portable and online monitoring systems for non-ionizing EMF measurement, as well as some measurement results in Tehran are discussed. First of all, standards and recommendations related to EMF monitoring, measurement and exposure such as ISIRI No.8567, ICNIRP guideline and ITU-K.83 are reviewed. Then, technical facts and operation of portable device and monitoring station are int...
متن کامل